COLOR INTERPOLATION PROCESSOR AND THE 
COLOR INTERPOLATION CALCULATION METHOD 

THEREOF 



Field of the Invention 

The present invention relates to a color interpolation processor and the color 
10 interpolation calculation method thereof. More particularly, it relates to a color 
interpolation processor and the color interpolation calculation method thereof that are 
implemented in a real-time image process system using charge couple devices (CCD) 
for sampling. Therefore the efficiency of color interpolation process will be enhanced, 
and the cost and the process time of color interpolation will be reduced also. 

15 

Back g round of thg In vention 

Presently, the CCD sensor is usually used for sampling in most of digital camera 
system. An incident light will be transformed to an electronic signal by utilizing the 
20 CCD according to the photoelectric effect. Then, the electronic signal will be 
converted and digitized for an image process and recorded by an analog/digital 
converter. Moreover, the sampling format usually is a color filter array (CFA) format 
in order to reduce the size of sensor. 

25 In digital sampling system using CCD as a sampling unit, there are three 
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departments. The first department is involved in the image process in the CCD 
sampling system, such as optical black alignment compensation, defect prevention, 
white balance and auto-white balance, and the separation and interpolation of color 
signal of CFA. From these image processes, a colorful image signal corresponding to 
5 every picture pixel is obtained, and then, a correction and compensation process 
follows, such as lens flicker compensation, hue correction, gamma correction, border 
correction and brightness adjustment, etc. 

Red (R), Green (G) and Blue (B) are three primary colors for images. When the 
10 CFA sampling format is used, only one color component of R, G, and B is taken at 
every sampling point. In order to make up the missing components for forming a 
complete color structure at every sampling point, a complicated calculation has to be 
performed to obtain two deficient colors by interpolation at every sampling point 
thereby enhancing the resolution of sampling image. 

15 

The so-called interpolation is to calculate and determine the unknown pixel 
among several known sampling points. There are lots of traditional computation 
methods for interpolation existing, such as nearest neighbor interpolation, bilinear 
interpolation, cubic B-spline interpolation and cubic convolution interpolation, etc. 

20 However, these traditional interpolation methods have their own defects respectively. 
For example, the calculating speeds of the nearest neighbor interpolation and bilinear 
interpolation are fast but lacking of good interpolation quality. A good image quality 
cannot be obtained because a blurred image always exists after the interpolation is done, 
so that the nearest neighbor interpolation and the bilinear interpolation are not suitable 

25 for use in the high resolution, high contrast image process system. 
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As to the cubic B-spline interpolation and the cubic convolution inteipolation, 
they require many parameters for the interpolating calculation, so that their calculating 
processes are very complicated. By utilizing the cubic B-spline interpolation and the 
5 cubic convolution interpolation, a good and accurate interpolation value can be 
obtained but their complicated calculations take a lot of time. Therefore, the cubic B- 
spline interpolation and the cubic convolution interpolation are not suitable for 
implementing in a real-time digital color sampling system. Moreover, in the digital 
color sampling system with CCD and CFA sampling format, colorful stains and blurred 
10 borders always appear in the image after the interpolation is done by the traditional 
interpolation methods. 

In order to enhance the image quality after interpolation, there are many methods 
provided, such as the discriminated color correlation approach and the enlarged 

15 neighborhood approach. However, the computational structures of these interpolation 
methods are too complicated. For example, many buffers are needed to record the 
parameters during the computation and numerous additions are required during the 
interpolation computation of two deficient colors in a sampling point. Therefore, the 
system source will be quickly consumed. If the aforementioned interpolation methods 

20 are implemented, the cost will increase greatly. Moreover, if the aforementioned 
interpolation methods are implemented in the real-time image process system, due to 
the long computing time for interpolation, the efficiency of the image process system 
will be decreased. 

25 
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Summary of the Invention 

In the view of the background of the invention described above, in the traditional 
image process system with sampHng by CCD and CFA format, especially for the real- 
5 time image process system, the traditional computation methods of interpolation, such 
as nearest neighbor interpolation, bilinear interpolation, cubic B-spline interpolation 
and cubic convolution interpolation, etc., fail to provide good quality and rapid 
calculation. Therefore, the product that utilizes the traditional computation methods 
of interpolation lacks of both good quality and rapid calculation of interpolation, 

10 

It is the principal object of the present invention to provide a color interpolation 
processor and the color interpolation calculation method thereof, and more particularly, 
relating to the implementation in a real-time image process system using charge couple 
devices (CCD) for sampling. Because the computation technique of the present 
15 invention is not complicated, the cost is lower for implementing the color interpolation 
calculation method of the present invention in an image signal process system. Thus, 
the production cost will be decreased tremendously. 

In accordance with the aforementioned purpose of the present invention, the 
20 present invention provides a color interpolation processor and the color interpolation 
calculation method thereof, and more particularly relating to the implementation in a 
real-time image process system using charge couple devices (CCD) for sampling. 
Because the luminance density that is determined by the green (G) component, the edge 
directions weighting and local gain approach are utilized mainly to perform the 
25 computation of G interpolation, thereby enhancing the image definition after 
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interpolation. Moreover, since the computation technique of the present invention is 
not compUcated, the computation of interpolation is fast, so that the present invention 
is suitable for being implemented in the real-time image process system, and further, 
only two buffers are required to record the data while in application, so that the cost is 
5 decreased effectively. 

Brief Description of the Drawings 

The foregoing aspects and many of the attendant advantages of this invention 
will become more readily appreciated as the same becomes better understood by 
10 reference to the following detailed description, when taken in conjunction with the 
accompanying drawings, wherein: 

Fig. 1 is an image data array of a preferred embodiment of the present invention 
which is sampled by CFA. 
15 Fig. 2 is an image data array of another preferred embodiment of the present 

invention which is sampled by CFA. 

Fig. 3 is a real-time color interpolation process system of a preferred 
embodiment of the present invention. 

Fig. 4 is an internal operational flow sheet of the color interpolation processor of 
20 a preferred embodiment of the present invention according to Fig. 3. 

Fig. 5 is a core operational flow sheet of a preferred embodiment of the present 
invention according to the image data array shown in Fig. 1 and the internal operational 
flow sheet shown in Fig, 4, 

Fig. 6 is a computational flow sheet for common parameters shown in Fig. 4, 
25 wherein the image data array of Fig. 1 is utilized. 
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Fig, 7 is a computational flow sheet for the differentials of horizontal/vertical 
edges according to Fig. 4, wherein the image data array of Fig. 1 is utilized. 

Fig. 8 is a diagram of separation performance of the horizontal and vertical 
differentials signal stream of a preferred embodiment of the present invention 
5 according to Fig. 7. 

Fig. 9 is a diagram of system clock, first clock and second clock of a preferred 
embodiment of the present invention according to Fig. 8. 

Fig. 10 is a computational flow sheet for the edge weighting of a preferred 
embodiment of the present invention. 
10 Fig. 11 is a diagram of system clock corresponding to the edge weighting of Fig. 

10. 

Fig, 12 is a flow sheet of the B local mean computation according to the mean 
computations of Fig. 4. 

Fig. 13 is a computational flow sheet for the R edge mean value and the G mean 
1 5 value according to the mean computations of Fig. 4. 

Detailed Description of the Preferred Embodiment 

In CFA pattern, only one color component is sampled in each cycle, so that one 
20 color component of R, G and B is taken at every sampling point. In order to 
reconstruct complete RGB components from CFA format, two colors components have 
to be computed by interpolation at every sampling point. Generally, the image 
resolution is mostly determined by image luminance density. Luminance density 
could be defined by RGB components as equation (1). 

25 
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Y = 0.59G + 0.1 1B+ 0.3 R 



(1) 



From the equation (1), it is shown that G component has the maximum 



weighting value for determining the luminance level, so that the interpolation of G 
5 component is more important than those of R and B. 

Referring to Fig. 1, which shows that an image data array of a preferred 
embodiment of the present invention, which is sampled by CFA. The image data 
array of Fig. 1 is constructed from the image data of four rows and nine columns. The 

10 image data of the first row and the third row are constructed from R sampling data and 
G sampling data spaced in-between. The image data of the second row and the foxarth 
row are constructed from G sampling data and B sampling data spaced in-between. 
First, the G24 interpolation is considered at the B24 position (as shown in Fig. 1, the 
intersection of the second row and the forth column of the image data array) for the 

15 introduction of the computation of interpolating a G component because the 
interpolation of G component is more important than those of R and B. 



interpolated resolution. First, as the equation (2) and the equation (3) shown below, 
20 the local vertical differential and the local horizontal differential are computed. 



To achieve high performance, the edge information is adopted to enhance the 



AV,= IG14-G34I 



(2) 



AH,= IG23-G25I 



(3) 
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The local vertical differential is the absolute value of G34 sampling data minus 
Gi4 sampling data. The local horizontal differential is the absolute value of G25 
sampling data minus G23 sampling data. 



K 10 
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Then, the G interpolation is computed by two steps. In the first step, weighting 
distribution is employed according to edge direction differential with the equation (2) 



and the equation (3). The G initial interpolation ( Gy ) of B24 is computed as shown 
in the equation (4). 



if AH = 0 md AV = 0 then 
AH + AV 



(1) _ 

24 



else 



G^V = ^i7x- 



AV 



= AHx 



AH + AV 
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■ + AVx- 



AH 



(4) 



AH + AV 



+ AVx{l 



AH + AV 
AV 



AH + AV 



) 



wherein 6^24 is the G initial interpolation at B24. =(G25+G23)/2 and 

^r=(Gi4+G34)/2 individually denotes the average interpolation from horizontal and 
vertical directions. From the equation (4), the interpolated value is based on AV and 
AH. As the differential of one direction is larger, the weighting value of the 
direction is decreased thereby preventing image blur. In the special case, when 
AF =0 and AH =0, the G24 initial interpolation is the average of AH and A V . 
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And then the local mean (LM) of B24 is computed as shown in the equation (5) 

. :^i±Ai±^i±^ (5) 
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wherein the is the interpolation value of G23. The G final interpolation 
(G^f ) is computed as shown in the equation (6) 



G(2)^G^Px~^(6) 



wherein B 2 4 / LM{B2^) is the local gain of B24. 

Then the following discussion is about the computation of R interpolation value 
10 of B24. First, the edge mean of R24 is computed as shown in the equation (7), 

And the R Interpolation ( ) will be computed as shown in the equation (8). 

15 

4=ZM(J?3,)x (8) 

Similarly, the G final interpolation ( G^'^^ ) of R33 is computed as shown in the 
equation (9) 

20 

4?=4^Px (9) 
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wherein the G'^^^ is the G initial interpolation of R33 and R3 3 / LM(R^^) is the 
local mean of R33. The local mean of R33 (LM(R33)) is computed as shown in the 
equation (10) 



LM(R,,) = ^^^^^^^^^^^^^ (10) 



wherein is the interpolation of G32 in Fig. 1 , 

; S As to the compxitation of the B interpolation of R33, the edge mean of B33 is 

J;Jf 1 0 computed as shown in the equation (11) first. 



1-4; 
J ; 

0 Then, the B interpolation ( £33) is computed as shown in the equation (12) 
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533 = LM(B^^)x — ^ — (12) 



wherein LM{R^^) is computed as shown in the equation (10). 

20 To compute the B interpolation and the R interpolation of G23> the mean value of 

G23 is computed as shown in the equation (13) first. 
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G,^ +G,^ +G^^ -hGr 

'23 > ~ 



LM{G,,) = -12-^-14 —34^-32 (13) 
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And then the R interpolation ( ) is computed as shown in the equation (14). 



^ if,, + 7?„ Go 

^23 



j;^^^-M3---33^ -23 (14) 



LM(G,,) 

The B interpolation ( ) of G23 is computed as shown in the equation (15) 



_ j5oo + G 

^23 



^,3= ^^ x (15) 



XM(G,3) 
10 

After the aforementioned descriptive example, the B interpolation and the R 
interpolation from the G sampling data, the G interpolation and the R interpolation 
from the B sampling data and the G interpolation and the B interpolation from the R 
sampling data are discussed. Therefore, the color interpolation calculation method of 
15 the present invention can be implemented in the image data array of Fig. 1 for the 
relational color interpolation for every sampling point. 

Referring to Fig. 2, which shows an image data array of another preferred 
embodiment of the present invention, which is sampled by CFA. The image data 
20 array of Fig. 2 is constructed from the image data of M rows and N columns, wherein 
M is an integer that is not smaller than 3 and N is an integer that is not smaller than 6. 
The color interpolation calculation method of the present invention can be 
implemented in the image data array constructed from a plurality of rows and a 
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plurality of columns for interpolation computation, and is not limited to the image data 
array of Fig. 1. 

Referring to Fig. 3, which shows a real-time color interpolation process system 
5 of a preferred embodiment of the present invention. In the real-time color 
interpolation process system 10, the image signal 12 from CCD is entered into an 
analog/digital converter (ADC) 16 for analog/digital conversion from an input terminal 
14, and then the sampling data formed by rows is outputted to a color interpolation 
processor 18. Meanwhile, the vertical and horizontal synchronous signals are entered 

10 into the color interpolation processor 18 for controlling the operation thereof. When 
the sampling data of the first row is inputted to the color interpolation processor 1 8, the 
color interpolation processor 18 does not operate, and the sampling data of the first row 
are saved into a buffer 22. Then, the sampling data of the second row are inputted to 
the color interpolation processor 18, and the color interpolation processor 18 does not 

15 operate either, and the sampling data of the second row are saved into a buffer 24. 
After the sampling data of the third row are inputted to the color interpolation 
processor 18, and the sampling data of the first row and the sampling data of the 
second row are inputted to the color interpolation processor 18 from the buffer 22 and 
the buffer 24 at the same time, then the computation begins. When the correlative 

20 color interpolations are obtained, the R, G and B components are outputted from the 
output terminal 26, 

In other words, when the sampling data of i row and i+1 row are inputted to the 
color interpolation processor 18, the sampling data of i row and i+l row are saved into 
25 the buffer 22 and the buffer 24. After the sampling data of the i+2 row are inputted to 
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the color interpolation processor 18, the color interpolation processor begins to operate. 
Therefore, only two buffers are utilized for real-time color interpolation computation in 
the color interpolation calculation method of the present invention, thereby obtaining 
the R, G and B components. Thus, the cost and the difficulty of implementation are 
5 decreased. 

Referring to Fig. 4, which shows an internal operational flow sheet of the color 
interpolation processor of a preferred embodiment of the present invention according to 
Fig. 3. First, the sampling data of i row, the sampling data of i+1 row and sampling 

10 data of i+2 row enter the color interpolation processor 18 from an input terminal 50 
and the computations for common parameter 52 and the differential computations for 
horizontal/vertical edges 54 are performed. Then the mean computations 56 are 
performed with the result from the computations for common parameter 52 for the 
local mean and the edge mean of the correlative color. For the G final interpolation, 

15 the edge weighting computation 58 is performed with the results from the 
computations for common parameter 52 and the differential computations for 
horizontal/vertical edges 54. After the G final interpolation is done, the edge mean 
and the local mean of the correlative color are obtained, and then the selection for 
interpolated components 60 is performed to generate an appropriate output signal. 

20 Then, a parallel step 62 is performed with the appropriate output signal and the result 
of computations for common parameter 52, thereby outputting a correlative 
interpolation from output 64. 

Referring to Fig. 5, which shows a core operational flow sheet of a preferred 
25 embodiment of the present invention according to the image data array of Fig. 1 and 
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the internal operational flow sheet of Fig. 4. The illustration of the core operational 
flow sheet of Fig, 5 is based on the interpolation computation of the sampling data of 
the second row (the i+1 row also) of the image data array of Fig. 1. For example, the 
signal stream 412 is outputted from the output terminal 102 of Fig, 5. The signal 
5 stream 412 is constructed with the correlative G final interpolation and B interpolation 
of the sampling data of the second row (the i+1 row also) of the image data array of Fig. 
L 

As shown in Fig. 5, for computing the correlative interpolation of the second 
10 row (the i+1 row also) of the image data array of Fig. 1, the signal stream 104, the 
signal stream 106, the signal stream 108, the signal stream 110 and the signal stream 
112 are required at least. To computing the R interpolation (i?23) and the B 
interpolation (^23) of G23 of the second row of the image data array of Fig. 1, G23 
sampling data of the sampling data 130 of the second row of the image data array of 
15 Fig. 1 is selected according to the equation (14) and the equation (15). Then the mean 
value of G23 (LM(G23)) is also selected by controlling the multiplexer 114. The G23 
sampling data is divided by LM(G23) through the divider 116 and the result after 
division is sent to the register 118 and then to the multiplicator 120 and the 
multiplicator 122. Meanwhile, ARi from the signal stream 104 is sent to the 
20 multiplicator 120 through the register 128 by controlling the multiplexer 124 for 
multiplying the result of division and the R interpolation ( ) of G23 is outputted from 
the output terminal 100; AB4 from the signal stream 106 is sent to the multiplicator 122 
by controlling the multiplexer 126 for multiplying the result of division, and then the B 
interpolation (^23 ) of G23 is outputted from the output terminal 102. 

25 
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As shown in the equation (4)^ the equation (5) and the equation (6), to compute 
the R interpolation (^^4 ) the G final interpolation (^2? ) B24 of the second row 
of the image data array of Fig. 1, B24 sampling data is selected from the second row and 
the local mean of B24 ( LM^B^^ ) ) is outputted from the signal stream 1 1 0 by 
5 controlling the multiplexer 114. Then, B24 sampling data is divided by LM{B^^) 
through the divider 116 and the result of division is sent to the multiplicator 120 and 
the multiplicator 122 through the register 118. Afterwards, the R local mean 
( LM(i?24) ) of B24 in the signal stream 1 12 is sent to the multiplicator 120 through the 
register 128 by controlling the multiplexer 124, and is multiplied by the result of 

1 0 division, and the R interpolation ( ) of B24 is outputted from the output terminal 1 00; 
the G initial interpolation ( G24 ) of B24 in the signal stream 108 is sent to the 
multiplicator 122 by controlling the multiplexer 126, and is multiplied by the result of 
division, and the G final interpolation (G^P) of B24 is outputted from the output 
terminal 102. The descriptions about generating every signal stream of Fig. 5 are as 

15 follows. 

Referring to Fig. 6, which shows a computational flow sheet for common 
parameters shown in Fig, 4, wherein the image data array of Fig. 1 is utilized. The 
sampling data of the first row (i.e. the i row) and the sampling data of the third row (i.e. 

20 the i+2 row) of the image data array of Fig. 1, are sequentially inputted from Ru and 
R31 to the adder 200 correspondingly for addition as shovm in Fig. 6. After the result 
of addition is shifted two bits rightward, ARi, AV2, AR3, AV4 and other common 
parameters are outputted correspondingly as shown in Fig. 6. Therefore, the signal 
stream 104 of Fig. 5 is constructed from the common parameters that are the output of 

25 the adder 200. Thus, to derive from the addition above, the red common parameter is 



15 



ARx=(Rix+R3x)/2 and the vertical average is AVx=(Gix+G3x)/2, wherein the x is an 
integer not smaller than 1 . 

At the same time, the sampling data of the second row (i.e. the i+1 row) and the 
5 sampling data delayed by two system clocks from the second row (i,e, the i+1 row) of 
the image data array of Fig, 1 are sequentially inputted from the G21 to the adder 202 
correspondingly for addition as shown in Fig. 6. After the result of addition is shifted 
two bits rightward, O, O, AH3, AB4 and other common parameters are outputted in 
order as shown in Fig, 6, wherein the "O" indicates nothing because there is no result 

10 of addition generated in the beginning of addition at the first system clock and the 
second system clock. The signal stream 106 of Fig. 5 is constructed from the 
common parameters that are the output of the adder 202. Thus, to derive from the 
addition above, the blue common parameter is ABx=(B2x+B2(x-2))/2 and the horizontal 
average for G component is AHx=(G2x+G2(x-2))/2, wherein the x is an integer not 

15 smaller than 1 . 

Referring to Fig. 7, which shows a computational flow sheet for the differentials 
of horizontal/vertical edges according to Fig. 4, wherein the image data array of Fig. 1 
is utilized. By utilizing the system clock 208 to control the multiplexer 204, the G 
20 sampling data are sieved from the sampling data of the first row (i.e. the i row) and the 
second row (i.e. the i+1 row) of the image data array of Fig. 1 as shown in Fig. 7, and 
sent to the subtracter 210 from G21 in order. 

Meanwhile, by utilizing the system clock 208 to control the multiplexer 206, the 
25 G sampling data are sieved from the sampling data of the third row (i.e. the i+2 row) 
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and the second row (i.e. the i+1 row) of the image data array of Fig. 1 as shown in Fig. 
7, and sent to the subtracter 210 from O in order, wherein the sampling data of the 
second row is delayed by two system clocks to input to the multiplexer 206 than the 
sampling data of the third row, and the "O" indicates nothing, because of no sieved 
5 result generated from the multiplexer 206 in the beginning of the first system clock and 
the second system clock, for the sampling data of the second row is delayed two system 
clocks to input to the multiplexer 206 than the sampling data of the third row. In all 
diagrams of a preferred embodiment of the present invention, the "O" indicates no 
signal or nothing corresponding to the time, or the "O" indicates the signal that is not 
10 utilized in a preferred embodiment of the present invention. 

The sieved result of the multiplexer 204 and that of the multiplexer 206 are 
inputted to the subtracter 2 1 0 for subtraction operation. After the result of subtraction, 
wherein O, AF2, A//3, AF4, A//5 and other horizontal and vertical differentials are 
15 outputted in order to construct the horizontal and vertical differentials signal stream 
212, wherein the "O" is the output of subtracter 210 at the first clock. The AV^, 
AF4 and other vertical differentials in the horizontal and vertical differentials signal 
stream 212 are based on the equation (15) 

20 AF,= !Gix-G3xl (15) 

The A//3 , A//5 and other horizontal differentials in the horizontal and vertical 
differentials signal stream 212 are based on the equation (16). 
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Ai7,= |G2x-G2(x-2)l (16) 

Referring to Fig. 8, which shows a diagram of separation performance of the 
horizontal and vertical differentials signal stream of a preferred embodiment of the 
5 present invention according to Fig, 7. In order to separate the horizontal and the 
vertical differentials from the horizontal and vertical differentials signal stream 212, 
the horizontal and vertical differentials signal stream 212 is sent to the multiplexer 214 
of Fig. 8 from the subtracter 210 of Fig. 7. 

10 Referring to Fig. 9, which shows a diagram of the system clock, the first clock 

and the second clock of a preferred embodiment of the present invention according to 
Fig. 8. The system clock 208 of Fig. 9 is inputted to the frequency divider 216 of Fig. 
8 for division operation. Then, the first clock 218 is sent to the multiplexer 214 of Fig. 
8, and the second clock 220 is sent to the register 222 of Fig. 8, wherein the period of 

15 the first clock 218 and that of the second clock 220 are double as much as the period of 
the system clock 208. 

Please referring the Fig. 8 and the Fig. 9, the horizontal differentials of the 
horizontal and vertical differential signal stream 212 are sent to the register 222 from 
20 the multiplexer 214 controlled by the first clock 218 of Fig. 9, when the first clock is at 
high level, and the vertical differentials of the horizontal and vertical differential signal 
stream 212 are sent to the register 222 from the multiplexer 214 controlled by the first 
clock 218 of Fig. 9, when the first clock is at low level. Therefore, the vertical 
differential signal stream 230 and the horizontal differential signal stream 240 of Fig. 8 
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are obtained in the same system clock, wherein the Ai/3 of the horizontal differential 
signal stream 240 corresponds to the AF2 of the vertical differential signal stream 230 
in the first system clock, and the AH^ of the horizontal differential signal stream 240 
corresponds to the AF4 of the vertical differential signal stream 230 in the second 
5 system clocks and so on. 

Referring to Fig. 10, which shows a computational flow sheet for the edge 
weighting of a preferred embodiment of the present invention. The horizontal 
differentials signal stream 240 and the vertical differentials signal stream 230 from the 

10 multiplexer 214 of Fig. 8 are sent to the adder 300 of Fig. 10 so as to obtain the signal 
stream 302 constructed of the result of addition ( AK, + A/f^^^j^), for example: 
( Zii/3+ AK2), ( Af/5+ AV^), etc. Then, the signal stream 302 is sent to the register 
304 controlled by the second clock 220 for zero-check. The zero-check is to check 
whether the AV^ and the AH^^^^y of the signal stream 302 are zero or in accordance 

15 with the equation (4). If the AV^ and the AH^^^^-^ of the signal stream 302 are zero, 
the computation would be stopped and the G initial interpolation would be computed 
and obtained according to the equation (4). If the AV^ and the AH^^^^^ of the signal 
stream 302 are not equal to zero, the signal stream 302 would be sent to the divider 306, 
and the corresponding signal of the horizontal and vertical differential signal stream 

20 212 would be divided by the corresponding parameter of the signal stream 302. 
Thereafter, the result of division is sent to the multiplicator 308. 

Meanwhile, the signal stream 106 and the signal stream 104 are sent to the 
multiplexer 310, and the horizontal average of the signal stream 106 is sent to the 
25 multiplicator 308 from the multiplexer 310 controlled by the first clock 218 when the 
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first clock 218 is at high level, and is multiplied by the corresponding parameter 
outputted from the divider 306 according to the equation (4), and then the result of 
multiplication is sent to an accumulation addition unit 312; the vertical average of the 
signal stream 104 is sent to the multiplicator 308 from the multiplexer 310 controlled 
5 by the first clock 218 when the first clock 218 is at low level, and is multiplied by the 
corresponding parameter outputted from the divider 306 according to the equation (4), 
and then the result of multiplication is sent to an accumulation addition unit 312 so as 
to add to the prior result of multiplication registered in the accumulation addition unit 
312. Afterwards, the signal stream 108 constructed of the G initial interpolation in 
10 Fig. 5 is outputted by the control of the system clock 208. 

m 

[U Referring to Fig. 11, which shows a diagram of system clock corresponding to 

Wi 

III the weighting computation of Fig. 8, Since no signal for handling appears in the first 
system clock, so that "O" is used as an indication. Then AH^ and AV2 are sent to 

12 1 5 the adder in the second system clock. In the third system clock, the result of addition 
of A/?3 and AP^ is obtained, and then AP^/( Ai73+ AF2) is computed, wherein 

1==^ AV2 of the horizontal and vertical differential signal stream 212 is divided by 

( AH^+ AV2) sent to the divider 306, and then AH^/( AH^+ AVj) is computed, 
wherein AH^ of the horizontal and vertical differentials signal stream 212 is divided 
20 by ( AH^+ AF2 ) from the control of the second clock 220. 

In the forth system clock, AFj /( AH^ + ) is multiplied by AH3 of the signal 
stream 106 that is sent to the multiplicator 308 from the multiplexer 310 controlled by 
the first clock 218, and the result of multiplication is sent to the accumulation addition 
25 unit 312. Then AHJ{ A//3+ AV^) is multiplied by AV2 of the signal stream 104 
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that is sent to the multiplicator 308 from the multiplexer 310 controlled by the first 
clock 218, and the result of multiplication is sent to the accumulation addition unit 312 
to add to the prior parameter. Meanwhile, hH^ and AF4 are sent to the adder. 
Then the G initial interpolation ( G22 ) of B22 is outputted by the control of the system 
5 clock 208 in the fifth system clock. At the same time, the performance step of A/fg 
and A F4 is similar to the performance step of A/f 3 and A at the third system clock, 
so that the signal stream 108 constructed of different G initial interpolation outputted 
from the accumulation addition unit 3 12 is obtained. 

10 Referring to Fig. 12, which shows a flow sheet of the B local mean computation 

of Fig. 4. In order to obtain the signal stream 110 constructed of B local mean value, 
the B sampling data are first sieved from the second row of the image data array of Fig. 
1, and the B interpolation is sieved from the signal stream 412 that is outputted from 
the output terminal 102 of Fig. 5. As shown in Fig. 12, the B interpolation of G23 and 

15 the B26 sampling data are sent to the adder 400 for addition operation. The result of 
addition and AB4 of the signal stream 106 are added together and shifted two bits 
rightward to obtain the signal stream 110 constructed of the B local mean value in Fig. 
5, wherein AB4 is derived from ABx = (B2x + B2(x-2))/2 . 

20 Referring to Fig. 13, which shows a computational flow sheet of the R edge 

mean value and the G mean value of Fig. 4. In order to obtain the signal stream 112 
constructed of the R edge mean value and the G mean value in Fig. 5, the signal stream 
104 is outputted from the adder 200 in Fig. 6, and the signal stream 104 that is delayed 
by two system clocks is sent to the adder 404 for addition operation. Therefore, the 

25 signal stream 1 12 constructed of the R edge mean value and the G mean value can be 
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obtained. 

After the signal stream 104, the signal stream 106, the signal stream 108, the 
signal stream 110 and the signal stream 112 are obtained from the computations 
5 described above, the interpolations corresponding to every sampling data of the image 
data array of Fig. 1 are obtained in order. Then the selection for interpolated 
components 60 is performed for selecting the appropriate output signal, and the parallel 
process 62 is performed with the appropriate output signal and the result of 
computations for common parameters, and the corresponding interpolation is outputted 
10 from the output 64 finally. 

The advantage of the present invention is to provide a high-performance color 
interpolation processor and the color interpolation calculation method thereof. By 
utilizing the color interpolation calculation method of the present invention in the 
15 image signal process system using CCD for sampling, the better interpolation quality is 
provided, and the time of computing interpolation is decreased at the same time, so that 
the efficiency of interpolation process is enhanced. Thus, the present invention is 
suitable for use in real-time image process system, thereby decreasing the cost. 

20 As is understood by a person skilled in the art, the foregoing preferred 

embodiments of the present invention are illustrated of the present invention rather 
than limiting of the present invention. It is intended to cover various modifications 
and similar arrangements included within the spirit and scope of the appended claims, 
the scope of which should be accorded the broadest interpretation so as to encompass 

25 all such modifications and similar structure. 
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